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| We introduce a simple technique for proving the transience of cer- 

. tain processes defined on the random tree Q generated by a supercrit- 

ical branching process. We prove the transience for once-reinforced 
random walks on Q, that is, a generalization of a result of Durrett, 
P-i Kesten and Limic [Probab. Theory Related Fields 122 (2002) 567- 

Qh ' 592]. Moreover, we give a new proof for the transience of a family of 

(— ( , biased random walks defined on Q. Other proofs of this fact can be 

found in [Ann. Probab. 16 (1988) 1229-1241] and [Ann. Probab. 18 
(1990) 931-958] as part of more general results. A similar technique 
is applied to a vertex-reinforced jump process. A by-product of our 
result is that this process is transient on the 3-ary tree. Davis and 
Volkov [Probab. Theory Related Fields 128 (2004) 42-62] proved that 
a vertex-reinforced jump process defined on the 6-ary tree is transient 
if b > 4 and recurrent if b = 1. The case b = 2 is still open. 

in 
t> 

\Q ' 1. Introduction. Consider a random tree Q generated by a supercritical 

. branching process, where the number of offspring for each individual are 

i.i.d. random variables with mean m, where 1 < m < oo. Some authors refer 
to Q as the genealogical tree associated to the branching process. The root 
of this random tree is designated by p. Let X := {X^, k > 0}, with Xq = p, 
be a process which takes as values the vertices of Q and jumps only to 
nearest neighbors, that is, vertices one edge away from the occupied one. 
The process is said to be transient if, with positive probability, it does not 
return to its starting point. If X visits each vertex only finitely many times 
$_i ■ a.s. we say that it drifts to infinity. A process that is not transient is said 
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to be recurrent, and if the time of the first return to the starting point has 
finite expectation, it is said to be positive recurrent. Our goal is to find a 
simple method that can be used to prove the transience of certain processes. 
We analyze some examples. The first one, given in Section 2, involves biased 
random walks. Other proofs of the result that we present were given by 
Pemantle, in [16], and by Lyons, in [11]. Theorem 2 of [16], and Theorem 
4.3 of [11] are more general and stronger results than Theorem 1 of this 
paper, and this is discussed at the end of Section 2. 

In Section 3 we prove the transience of once-reinforced random walks 
defined on Q. It is a generalization of a result due to Durrett, Kesten and 
Limic (see [10]), who proved that once-reinforced random walks defined on 
the binary tree drift to infinity. Notice that these cases were studied by 
different authors with totally different methods. The aim of this paper is 
to present a simple unifying approach. It relies on the construction of a 
supercritical branching process. 

In Section 4 a similar method is used to prove that a vertex-reinforced 
jump process (VRJP) defined on Q, with m > 1/0.36, is transient. A 6-ary 
tree, denoted by , is an infinite rooted tree where each vertex has 6+1 
neighbors, with the exception of the root, which is connected to b vertices. 
Davis and Volkov, in [8] , proved that VRJP defined on drifts to infinity 
if b > 4, and visits each vertex infinitely many times if b = 1. Our result, 
combined with a zero-one law, implies that this process drifts to infinity on 
T". The case b = 2 is still open. 

Definition 1. For any pair of vertices G £/, denote by \v — p\ the 
number of edges on the unique self- avoiding path connecting v to p, and let 
\u\ := \v — p\. If \v — /i| = 1, then v and p are (nearest) neighbors, and this 
is denoted by v ~ p. The set of vertices v with |z^| = n is called level n. If 
v ^ p, the parent of u, designated by par(z^), is defined to be the neighbor of 
v at level |z/| — 1. The vertex v is a child of par(^). A vertex p is said to be a 
descendant of v if the latter lies on the unique self-avoiding path connecting 
p to p. In this case, the vertex v is said to be an ancestor of p. Define 

T v :=inf{/c>0:X fc = z/}, 

H u := inf{/c > T v : X k = par(i/)}, 

T:=inf{j>l:X,- = p}. 

2. Biased random walk. Fix A > 0. Define the biased random walk X on 
Q as follows. Suppose it starts from p, that is, Xq = p. For any rooted tree 
E, given that {Q = T,}, we have that X is a Markov process on S. Given 
that {Xj = v^p},\iv has s children, s > 0, then 

P(X i+1 = par(i/))=A/(A + s), 
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and the probability that Xj+i equals any particular child of v is equal to 
1/(A + s). Suppose that {Xj = p} and the root has s children, if s > 1, then 
the probability that Xj + \ equals any particular child of p is equal to 1/s, 
and if s = 0, then Xj + \ = p. Before we study the behavior of this process, we 
recall a classical result in probability: the ruin problem. Consider a random 
walk defined on the non-negative integers. If the process is at j > 1, at the 
next stage it jumps either to j + 1, with probability p, where < p < 1, or 
to j — 1, with probability q = 1 — p. The walk starts from 1 and is absorbed 
at 0. The probability that this process hits n + 1 before it hits is equal to 

(1) ((q/p)-l)/((q/p) n+1 -l), iip^q, 

and l/(n+ 1) if p = q = l/2. 



Remark. Throughout this paper, we always assume that Q is supercrit- 
ical, that is, 1 < m < oo. 

Theorem 1. The biased random walk X defined on Q is as follows: 

(i) transient if < A < m, and 

(ii) positive recurrent if A > m. 

Proof, (i) For simplicity, we assume that A ^ 1, leaving to the reader 
the easy task to modify the proof to the case A = 1. We assume that r < oo 
a.s., that is, X returns to the root a.s. This would imply that H u < oo, 
a.s., for each vertex v that is visited by the process. In fact, on {T u < oo}, 
the process \X^ — par(V)|, with T u < k < H u , is distributed like |A^|, with 
1 < k < t. 

Choose n such that 

(2) m n (A-l)/(A n+1 -l)>l. 

If we prove that the process visits, with positive probability, an infinite 
number of vertices before time r, then we would have that P(r = oo) > 0, 
which gives a contradiction. For any vertex v at level (k — l)n, k>2, which 
satisfies {T u < oo}, define x u to be the number of vertices at level kn which 
are descendants of v and are visited during the interval [T„, H v \. Notice that 
x u , with \u\ = [k — l)n and {T„ < oo}, are i.i.d. We introduce the following 
color scheme. A vertex at level n is white iff it is visited before time r. A 
vertex p at level kn, k > 2, is white iff we have the following: 

• its ancestor at level (k — l)n, say, v, is white, and 

• u is visited before time H u . 
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All the other vertices are uncolored, and only vertices that are at a level 
kn, k > 1, can be colored. The white vertices are visited before time r. The 
number of white vertices evolves like a branching process where each individ- 
ual has a number of offspring distributed like x u , with T u < oo. We have to 
prove that this branching process is supercritical, that is, E^IT^ < oo] > 1. 
Suppose there exists a pair of vertices //, u, such that /i is a descendant of 
v, with \p\ = kn, \v\ = (k — l)n and T u < oo. Due to our assumption of re- 
currence, finding the probability that n is visited during the time interval 
[T U ,H U ] is equivalent to solving the ruin problem, with p = 1/(1 + A), on the 
shortest path connecting par(^) to u. Hence, in virtue of (1), we have that 
this probability equals (A — l)/(A n+1 — 1). As \v\ = (k — l)n, the expected 
number of descendants of v at level kn is m n . Hence, 

E[x„\T v < oo] = m n (A - l)/(A n+1 - 1) > 1. 

(ii) For any vertex u, with \u\ = n, we have 

P(T,<r)<(A-l)/(A"-l). 

To see this, notice that, in order to have \T V < r}, X\ must be an ancestor 
of v, and Xf~, k > 1, must hit v and this has to happen before it hits p. 
Hence, the expected number of vertices at level n, which are visited by the 
process before time r, is at most m n (A — l)/(A n — 1). Therefore, 

E[t] = 1 + E [number of vertices visited before time r] 

oo 

< 1 + m n {\ - l)/(A n - 1) < oo, 

n=l 

where the series is finite because A > m > 1. □ 

In the case m = A, the walk is recurrent (see [12], Remark 6, page 132), 
but not positive recurrent. To prove this last statement, let Z be the number 
of children of p, and choose j such that P(Z = j) > 0. Suppose {Z = j}. The 
probability to hit any given vertex v at level n is equal to the probability that 
the first jump is toward an ancestor of v, that is, times the probability 
that the process hits v before it goes back to p. As the expected number of 
vertices at level n is jm n , and A = m > 1, we have 

oo 

E[r]/P(Z = j) > B[t\Z = j] = l + (jm n -\m - l)/(m n - 1)) = oo. 

n=l 

In [11] Lyons proved a stronger result than Theorem 1. Lyons used the 
notion of branching number, which measures the average number of chil- 
dren per vertex, and proved that a biased random walk defined on a tree 
drifts to infinity (is recurrent) if A < (>) the branching number of that tree. 
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Moreover, Lyons proved that, given that the random tree Q is infinite, its 
branching number is a.s. equal to m. In [12] Lyons and Pemantle obtained 
sharp results of this kind for random walks in a random environment, com- 
bining and improving the results obtained in [11] and [16]. In [13] Lyons, 
Pemantle and Peres studied the speed of biased random walk defined on Q. 

3. Once-reinforced random walk. Let £ be a graph with the property 
that each vertex is the endpoint of a finite number of edges. Fix 5 > and 
define a discrete time process X, called once-reinforced random walk, as 
follows. It takes as values the vertices of £. Initially all the edges are given 
weight 1, and Xq = p. When an edge is traversed for the first time, that is, 
the process jumped from one of its endpoints to the other for the first time, 
the weight of the edge becomes d and is never changed again. The process 
jumps to nearest neighbors with probabilities proportional to the weights of 
the connecting edges. More formally, for any pair of neighbors v and let 
Go(v,/i) : = 0, and for k > 1, let 

Gkiy, fi) := {Xj £ {V, /i} and Xj + ± G {u, /x} for some < j < k — 1}. 

Define Zk(u, fi) := 5Ic k (v^) + 1- ^G k (u,fj,)^ where / stands for the indicator 
function. Given {Xj, with 1 < j < k}, we have that 

P(X k+ i = n\X h = v) = z k (u,[j,)/ z k(v,v)- 

For example, if we consider once-reinforced random walk defined on the 
nonnegative integers, with Xq = 0, we have X\ = 1, and 

P(X 2 = 2,X 3 = l,X 4 = 2) = (1/(1 + S))(S/(1 + 6)){6/{6 + 5)). 

Lemma 1. Consider once-reinforced random walk on the nonnegative 
integers, which starts from 0. The probability that, after the first jump, it 
hits level n + 1 before it hits is equal to 

n 

(3) nov(i+ 5 ))- 

Proof. Suppose that, after the first jump, the process hits level j before 
it hits again. It is enough to prove that the probability that the process 
hits level j + 1, before it hits 0, is equal to j / (j + 5). To see this, notice that 
either the walk hits j + 1 right away, with probability 1/(1 + 5), or it jumps 
to j — 1. If it jumps to j — 1, from the solution of the ruin problem for the 
simple fair random walk, we have that the probability that the process goes 
back to j before it hits is equal to (j — l)/j. By repeating this argument 
and summing the series, we get our result. □ 
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Fix n such that 

n 

m n U(j/(j + 8))>l. 
i=i 

Theorem 2. The once-reinforced random walk X defined on the random 
tree Q is transient. 

Proof. As in the proof of Theorem 1, part (i), we suppose that r < oo 
a.s., that is, X returns to the root a.s. This assumption implies that H u < oo, 
a.s., for each vertex v that is visited by the process. For any vertex v, with 
\u\ = {k — l)n, k>2, and \T V < oo}, let x v be the number of vertices at level 
kn which are descendants of v and are visited during the interval [T V ,H U ]. 
As before, to get our result, it is enough to show that Efx^jT^ < oo] > 1. By 
reasoning as in the proof of Theorem 1, part (i), and by Lemma 1, we have 
that 

n 

E[x,|r,<oo] = m n nO'/(i+^))> 1 - D 

j=l 

Recall that is the binary tree. By Theorem 2, once-reinforced random 
walk on is transient. This fact, combined with Lemma 1 of [10], implies 
that the process drifts to infinity. This result was first obtained by Durrett, 
Kesten and Limic [10] by using different methods. 

Very little is known about the behavior of once-reinforced random walks 
on graphs with cycles. In particular, it is not known whether once-reinforced 
random walks are transient or recurrent on the d-dimensional lattice, where 
d>2. This question was raised by B. Davis. 

The class of reinforced random walks (RRWs) is composed by stochastic 
processes with strong memory, and includes a once-reinforced random walk. 
These processes jump between nearest neighbor vertices of a graph, and 
prefer visiting often visited vertices over seldom visited ones. The theory 
of RRWs is full of open problems. For more about this topic the reader is 
referred to [2, 3, 5, 6, 14, 15, 16, 17, 18, 19, 20]. Applications of this theory 
can be found in [9, 12] and [13]. 

4. Vertex-reinforced jump process. Recall that £ is a graph with the 
property that each vertex is the endpoint of a finite number of edges. The 
following, together with its starting point, defines a right continuous process 
X := {X s ,s > 0}. This process, which was conceived by W. Werner, takes 
as values the vertices of £, and jumps only to nearest neighbors. Given 
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X s , < s < t, and {Xt = x}, the conditional probability that, in the interval 
(t, t + (it) , the process jumps to the nearest neighbor y of x is where 



For example, consider VRJP on the integers, which starts at 0. It waits an 
exponential amount of time at 0, say, t/o, then it jumps, independently of 770, 
to either —1 or 1, with probability 1/2. Suppose it jumps to 1. Given the past, 
it waits there an exponential amount of time, say, 771, with parameter 2 + 770 , 
then it jumps, independently of 771, toward either or 1. The probability 
that it jumps to is (1 + 770) / (2 + 7/0). 

From now on, X := {Xt,t > 0} is used to denote VRJP defined on the 
random tree Q, with 1/0.36 < m < 00. The aim of this section is to prove 
that, with positive probability, X does not return to the root, that is, is 
transient. As before, our proof relies on the construction of a supercritical 
branching process related to X. Davis and Volkov, in [8], proved transience 
for VRJP defined on T^ h \ b > 4, by constructing a simple random walk 
with positive drift, that at any time bounds from below the distance of the 
process from the root. Davis and Volkov, in [8], also proved a zero-one law 
for VRJP on 7~( fe ), that is: 

(a) either this process visits each vertex infinitely often a.s., or 

(b) it visits each of them only finitely often a.s. 

This result implies that if VRJP on is transient, then it drifts to in- 
finity. Recall that T u = inf{t > 0:Xt = v}. The following construction is 
due to Davis and Volkov (which was [8]). For each ordered pair of neigh- 
bors (u,v), assign a sequence hi(u,v), i > 1, of independent exponentials 
with mean 1. Let £1 = T u . The first jump after £1 is at time £>i := £1 + 
min„ /7i(ti,7;)(L(7;,£i)) _1 , where the minimum is taken over the set of neigh- 
bors of u. The jump is toward the neighbor v for which that minimum is 
attained. Suppose that we have defined {£j, &j}i<j<i-i, and let 



j v — 1 = j u>v — 1 := number of times X jumped from u to v by time . 

The first jump after £j happens at time bi :=£i + min,_, hj v (u, v)(L(v, , 
and the jump is toward the neighbor v for which that minimum is attained. 

Theorem 3. X is transient. 

Proof. Recall that, for any vertex v 7^ p, H u = mf{t >T v :Xt = par(^)}. 
Assume that X returns a.s. to the root. As before, this implies that H u < 00, 




& := inf{i > bi-i :X t =u} 



and 
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for each vertex v that is visited by the process. We introduce the following 
color scheme. The only vertex at level 1 that is green is the first one to be 
visited by X. A vertex fj,, with \/j,\ > 2, is green iff it is visited before time 
-f^par(/i) an d its parent is green. It is enough to show that, with positive prob- 
ability, there is an infinite number of green vertices. Fix a vertex v ^ p, and 
let My be the largest subtree of Q rooted at v. Notice that M v is random. 
Let C be any event in 

T := cr(hi(r)o,r]i) : i > 1, with 770 ~ r)i and both rjo and rji £ My), 

that is, the cr-algebra that contains the information about Xt observed 
outside M u . Given C D {v is green}, the distribution of ^i(par(^), v) is 
stochastically dominated by an exponential(l). To see this, first notice that 
/ii(par(z/), v) is independent of C. Let D := {par(z/) is green} G T. There 
exists a random variable Y, independent of foi(par(i/), u), such that 

[v is green} = {/ti(par(z/), v) < Y} n D. 

At this point, it is enough to realize that 

P(/ii(par(z/),z/) >x\{hi(pax(v),u) <Y}f\Cf\D) <P(/ii (par >x). 

Hence, for a vertex \x that is a child of v, we have 

P[/x is green|{z^ is green} n C] > E[l/(2 + /ii(par(z^), u))] 

roc 

= / exp{-z}/(2 + z)dz. 
Jo 

On {T u < 00}, define y u to be the number of children of v which are visited 
during the interval \T U , H v \ . We have that 

~Ei[y v \{y is green} n C] > m / exp{— z}/(2 + z) dz 

(4) J " 

= m(0.36...) > 1. 

If we let S n be the number of green vertices at level n + 1, we deduce from (4) 
that S n , n > 1, is stochastically larger than a supercritical branching process, 
where each individual has a number of offspring with mean m(0.36 . . .) > 1. 
Hence, with positive probability, there exists an infinite cluster of green 
vertices. □ 

A corollary of Theorem 3 is that VRJP on the is transient, hence, 
it drifts to infinity. This result can be easily extended to the case of VRJP 
defined on a tree where all but finitely many vertices have at least four 
neighbors. Davis and Volkov [7] studied VRJP on the integers. Results about 
the behavior of this process defined on can be found in [8] and [1]. 

Remark. Russell Lyons pointed out to me a paper of Dai [4] which was 
published while this paper was in print and contains a completely different 
proof of Theorem 2. 



TRANSIENCE ON GALTON-WATSON TREES 



9 



Acknowledgments. I would like to thank Adele Galasso, the referee and 
an Associate Editor for helpful comments. I would like to thank Burgess 
Davis for introducing me to the beautiful subject of reinforced random walks. 

REFERENCES 

[1] Collevecchio, A. (2005). Limit theorems for vertex-reinforced jump processes on 
certain trees. Unpublished manuscript. 

[2] Collevecchio, A. (2006). Limit theorems for reinforced random walks on certain 
trees. Probab. Theory Related Fields. To appear. 

[3] Coppersmith, D. and Diaconis, P. (1987). Random walks with reinforcement. Un- 
published manuscript. 

[4] Dai, J. J. (2005). A once edge-reinforced random walk on a Galton- Watson tree is 

transient. Statist. Probab. Lett. 73 115-124. MR2159246 
[5] Davis, B. (1990). Reinforced random walk. Probab. Theory Related Fields 84 203- 

229. MR1030727 

[6] Davis, B. (1999). Reinforced and perturbed random walks. In Random Walks 
(P. Revesz and B. Toth, eds.) 9 113-126. Bolyai Soc. Math. Studies, Budapest. 
MR1752892 

[7] Davis, B. and Volkov, S. (2002). Continuous time vertex-reinforced jump processes. 

Probab. Theory Related Fields 84 281-300. MR1900324 
[8] Davis, B. and Volkov, S. (2004). Vertex-reinforced jump process on trees and finite 

graphs. Probab. Theory Related Fields 128 42-62. MR2027294 
[9] Diaconis, P. and Rolles, S. W. W. (2006). Bayesian analysis for reversible Markov 

chains. Ann. Statist. 34. To appear. 
[10] Durrett, R., Kesten, H. and Limic, V. (2002). Once reinforced random walk. 

Probab. Theory Related Fields 122 567-592. MR1902191 
[11] Lyons, R. (1990). Random walks and percolation on trees. Ann. Probab. 18 931-958. 

MR1062053 

[12] Lyons, R. and Pemantle, R. (1992). Random walk in a random environment and 

first-passage percolation on trees. Ann. Probab. 20 125-136. MR1143414 
[13] Lyons, R., Pemantle, R. and Peres, Y. (1996). Biased random walks on Galton- 

Watson trees. Probab. Theory Related Fields 106 249-264. MR1410689 
[14] Muliere, P., Secchi, P. and Walker, S. G. (2000). Urn schemes and reinforced 

random walks. Stochastic Process. Appl. 88 59-78. MR1761692 
[15] Othmer, H. and Stevens, A. (1997). Aggregation, blowup, and collapse: The 

ABCs of taxis and reinforced random walk. SIAM J. Appl. Math. 57 1044-1081. 

MR1462051 

[16] Pemantle, R. (1988). Phase transition in reinforced random walks and rwre on 

trees. Ann. Probab. 16 1229-1241. MR0942765 
[17] Pemantle, R. (2001). Random processes with reinforcement. Preprint. Available at 

www .math. upenn. edu/~pemantle/papers/Papers .html . 
[18] Pemantle, R. (1992). Vertex-reinforced random walk. Probab. Theory Related Fields 

92 117-136. MR1156453 
[19] Pemantle, R. and Peres, Y. (1996). On which graphs are all random walks in 

random environments transient? In Random Discrete Structures (R. Pemantle 

and Y. Peres, eds.) 207-211. Springer, New York. MR1395617 
[20] Pemantle, R. and Stacey, A. M. (2001). The branching random walk and contact 

process on Galton-Watson and nonhomogeneous trees. Ann. Probab. 29 1563- 

1590. MR1880232 



10 



A. COLLEVECCHIO 



[21] Pemantle, R. and Volkov, S. (1999). Vertex-reinforced random walks on Z have 

finite range. Ann. Probab. 27 1368-1388. MR1733153 
[22] Rolles, S. W. W. (2003). How edge-reinforced random walk arises naturally. Probab. 

Theory Related Fields 126 243-260. MR1990056 
[23] Rolles, S. W. W. (2006). On the recurrence of edge-reinforced random walks on 

ZxG. Probab. Theory Related Fields. To appear. 
[24] Sellke, T. (1994). Reinforced random walk on the d-dimensional integer lattice. 

Technical Report 94-26, Dept. Statistics, Purdue Univ. 
[25] Volkov, S. (2001). Vertex-reinforced random walk on arbitrary graphs. Ann. Probab. 

29 66-91. MR1825142 



DlPARTIMENTO DI SCIENZE 

Universita G. D'Annunzio 

VlALE PlNDARO 87 

65127 Pescara 
Italy 

E-MAIL: colle@sci.unich.it 



